Image Processing Apparatus, Image Editing Apparatus, Image 
Editing Method, and Image Editing Program 

[0001] This application is based on Japanese Patent 

Application No. 2000-277052 filed on September 12, 2000, the 
contents of which are hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0002] The invention relates to an apparatus, method and 
program for editing images . 

2 . Description of Related Art 

[0003] Various editing methods are known for effectively 
using image data depending on the purpose of uses. 
[0004] Japanese Patent Unexamined Publication No. 5-89103 
(A) discloses a document editing and processing apparatus 
for automatically renumbering graphics numbers, drawing 
numbers and table numbers that are referred to in a document 
in the process of renumbering numbers in the vicinity of such 
graphics, drawings and tables in the document according to 
the editing such as addition, insertion, deletion and 
replacement of pages. In the apparatus, the numbers before 
editing, the new numbers, and the locations in a document 
of the graphics , drawings and tables are inputted by the user. 



[0005] Japanese Patent UnexaminedPublicationNo. 8-255160 
(A) discloses an editing method for automatically laying out 
visually recognizable information such as characters, 
graphics, photographs and images within a specified area. 
The method provides a means of automatically adding layout 
information for displaying electronic image data on a display 
device. 

[0006] Japanese Patent Unexamined Publication No. 

10-228473 (A) discloses a method of automatically generating 
links between drawings such as diagrams and tables included 
in the image and the text related thereto, and converting 
them into hypertexts. 

[ 0007 ] The method includes the steps of detecting captions , 
detecting specified character strings related to drawings 
from the captions , and detecting character strings identical 
to the detected character strings from character areas to 
generate links between the character strings in the captions 
and the character strings in the character areas, based on 
the positional relations between the areas where the diagrams 
and tables exist and neighboring character areas . A caption 
is a character string provided in the vicinity of a drawing 
and contains notations or descriptions for identification 
the drawing. 

[0008] Japanese Patent Unexamined Publication No . 11-85741 
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(A) discloses a method of editing for automatically laying 
out drawing numbers, which are a kind of notations for 
identification drawings , in optimum locations . In the method, 
the drawing numbers are automatically allocated to the 
drawings based on the setting of drawing number parameters. 
[0009] On the other hand, when a plurality of documents 
are copied simultaneously, there can be several identical 
drawing numbers and page numbers. Consequently, the 
relations between the drawings and the drawing numbers as 
well as page orders can be confusing and contradictory. This 
makes it difficult to compiling documents and may lower the 
documents ' values . 

[0010] On the other hand, the apparatus disclosed by 
Publication No. 5-89103 requires the user to specify the 
information concerning renumbering, so that it places a heavy 
burden on the user. The method disclosed by Publication No. 
8-255160 is intended for the layout of documents such as 
newspapers and magazines where drawing numbers are not 
indicated . 

[0011] The method disclosed by Publication No. 10-228473 
is simply using the existing drawing numbers. The method 
disclosed by Publication No. 11-85741 is to re-allocate 
drawing numbers. Therefore, these methods disclosed on the 
Publications cannot deal with the present problem. 
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SUMMARY OF THE INVENTION 
[0012] A general object of the invention is to provide 
consistent relations between notations that identify drawings . 
or pages and corresponding drawings or pages contained in 
a document produced by integrating several documents. 
[0013] It is still more specific object of the invention 
to provide an image editing method including the steps of: 
(a) receiving a first document data and a second document 
data obtained by reading respectively a first document and 
a second document each having at least one drawing and a drawing 
number located in the vicinity of the drawing; (b) recognizing 
the drawing numbers from the first document data and the second 
document data; (c) changing corresponding data in the first 
document data and the second document data so that the 
recognized drawing numbers do not overlap each other; and 
(d) printing an image based on the changed first and second 
document data. 

[0014] A further object of the invention is to provide an 
image editing method including the steps of: (a) receiving 
a first document data and a second document data obtained 
by reading respectively a first document and a second document 
each having a page number printed; (b) recognizing the page 
numbers from the first document data and the second document 
data; (c) changing corresponding data in the first document 
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data and the second document data so that the recognized page 
numbers do not overlap each other; and (d) printing an image 
based on the changed first and second document data. 
[0015] Still a further object of the invention is to provide 
an image processing apparatus including a receiving unit, 
an extraction means, and a conversion means. The receiving 
unit receives a first document data and a second document 
data obtained by reading respectively a first document and 
a second document each having at least one drawing. The 
extraction means extracts a first caption group for 
identifying the drawing contained in the first document and 
a second caption group for identifying the drawing contained 
in the second document. The conversion means converts the 
first caption group and the second caption group into a third 
caption group so that a character string in the first caption 
group does not overlap a character string in the second caption 
group. 

[0016] Still a further object of the invention is to provide 
an image editing apparatus including a receiving unit, a 
recognizing means, a changing means, and a printing unit. 
The receiving unit receives a first document data and a second 
document data obtained by reading respectively a first 
document and a second document each having at least one drawing . 
The recognizing means recognizes the drawing numbers from 
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the first document data and the second document data. The 
changing means changes corresponding data in the first 
document data and the second document data so that the 
recognized drawing numbers do not overlap each other. The 
printing unit prints an image based on the changed first and 
second document data. 

[ 0017 ] Still a further object of the invention is to provide 
an image editing program for causing a computer to execute 
the procedures of: (a) receiving a first document data and 
a second document data obtained by reading respectively a 
first document and a second document each having at least 
one drawing and a drawing number located in the vicinity of 
the drawing; (b) recognizing the drawing numbers from the 
first document data and the second document data; (c ) changing 
corresponding data in the first document data and the second 
document data so that the recognized drawing numbers do not 
overlap each other; and (d) printing an image based on the 
changed first and second document data. 

[0018] The objects, characteristics, and advantages of 
this invention other than those set forth above will become 
apparent from the following detailed description of the 
preferred embodiments, which refers to the annexed drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0019] Fig. 1 is a block diagram of an image processing 
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system related to the first embodiment according to the 
invention; 

[0020] Fig. 2A and Fig. 2B collectively illustrate an 
example allocation table used for consistency process for 
an image processing apparatus of the image processing system; 
[0021] Fig. 3 is a flow chart of the consistency process; 
[0022] Fig. 4 is a flow chart of a first correlating process 
in the consistency process; 

[0023] Figs. 5A and 5B are example images of first and second 
pages as input images to which the consistency process is 
applied; 

[0024] Fig. 6A and Fig. 6B collectively illustrate an 
example of the allocation table after the first correlating 
process is applied; 

[0025] Fig. 7 is a flowchart of a second correlating process 
in the consistency process; 

[0026] Fig. 8A and Fig. 8B collectively illustrate an 
example of the allocation table after the second correlating 
process is applied; 

[0027] Figs. 9A and 9B are example output images after the 
consistency process is applied, corresponding to Figs. 5A 
and 5B respectively; 

[0028] Fig. 10 is a flow chart of a consistency process 
of the second embodiment according to the invention; 
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[0029] Fig. 11 is a flow chart of an updating process to 
an allocation table in the consistency process; 
[0030] Fig. 12A and Fig. 12B collectively illustrate an 
example of the allocation table after the updating process; 
[0031] Fig. 13A and Fig. 13B collectively illustrate an 
example of the allocation table after a second correlating 
process; and 

[0032] Fig. 14 is an example output image, to which the 
consistency process is applied. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 
[0033] The embodiments of this invention will be described 
below with reference to the accompanying drawings . 
[0034] The image processing system of the first embodiment 
includes, as shown in Fig. 1, an image processing apparatus 
10, a controller 20, an operating panel 30, an image input 
apparatus 40, a first output apparatus 50, and a second output 
apparatus 60. 

[0035] The image processing apparatus 10 has a character 
recognition unit 11, an area separation unit 12, a bitmap 
processing unit 13 , a vector conversion unit 14 , a binarization 
unit 15, a synthesizing unit 16, a memory 17, and a format 
conversion unit 18. 

[0036] The controller 20 has an interface 22 for the 
operating panel 30, an interface 23 for the image input 
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apparatus 40, an interface 22 for the first output apparatus 
50 and the second output apparatus 60, and a central processing 
unit (CPU) 21 that controls the interfaces 22 through 24. 
[0037] The operating panel 30 is used by the operator for 
inputting instructions. The image input apparatus 40 is an 
image reading apparatus such as a color scanner. The first 
output apparatus 50 is an image forming apparatus such as 
a color printer, and the second output apparatus 60 is an 
apparatus for displaying and data processing the image data 
tobeoutputted, for example, a computer equipped with a display 
device. 

[0038] Functions of each unit will be described in detail 
along the operation flow. 

[0039] The user inputs the instruction information using 
the operating panel 30. The instruction information can be, 
for example, an operation start instruction or an instruction 
for a manual setting item. 

[0040] Manual setting items include a consistency process 
instruction, a post-processing selection, a readout mode, 
and an output format selection. 

[0041] The consistency process is a kind of editing function, 
and it is a process for providing a consistent relation between 
a drawing and a character string contained in a caption as 
a drawing identification description, or a description for 
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identifying the drawing. The consistency process in the first 
embodiment, wherein a plurality of related documents (a first 
document and a second document) are copied simultaneously, 
is a process of generating a copied document ( a third document ) 
containing a group of captions with consistent descriptions 
for drawing identifications. 

[0042] The drawing identification descriptions include, 
in addition to number notations, combination notations and 
relative position notations . The combination notations are, 
for example, notations consisting of numbers and alphabet 
characters such as 1A and IB, as well as character strings 
meaning drawings and numbers such as Fig. 1 and Fig. 2 or 
Figure 1 and Figure 2. The relative position notations are, 
for example, "drawing on the right" and "drawing above." 
[0043] In the consistency process according to the first 
embodiment, a consistent relation is given to a character 
string as a page number identification description or a 
description for identifying a page number. The page number 
identification descriptions include number notations and 
combination notations. The combination notations in this 
case are notations consisting of numbers and alphabet 
characters, e.g. , "1A" and "IB," as well as character strings 
meaning pages and numbers, e.g., "P. 1" and "P. 2" or "PAGE 
1" and "PAGE 2." 
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[0044] The post-processing selection is a mode for 

selecting the post-processing that is applied to the three 
types of areas that are separated in the character recognition 
unit 11 and the area separation unit 12, i.e. , character areas, 
graphics areas , and photographic areas . The post-processing 
includes character coding at the character recognition unit 
11 , bitmap processing at the bitmap processing unit 13 , vector 
conversion at the vector conversion unit 14, and binarization 
at the binarization unit 15. 

[0045] The readout mode consists of the color mode for 
treating a document image as a color image and a monochromatic 
mode for treating a document image as a monochromatic image 
at the image input apparatus 40. 

[0046] The output format selection is a mode for selecting 
the format of the output file to be prepared at the format 
conversion unit 18. The output formats are general-purpose 
file formats, e.g., the document file format, the page 
description language format, the file format for document 
display, and the file format for storing images. 
[0047] For example, the document file format is the Rich 
Text Format, the page description language format is the 
PostScript (R), the file format for document display is the 
PDF ( Portable Document Format ) , and the file format for storing 
images is either the JPEG ( Joint Photographic Experts Group ) 



- 11 - 



or the TIFF (Tagged Image File Format). 

[0048] The instruction information from the operating 
panel 30 is transmitted to the controller 20 via the interface 
22. 

[0049] As it receives instruction information for the 
manual setting items, the controller 20 inputs the manual 
setting items to the image processing apparatus 10. 
Furthermore, as it receives the operation start instruction, 
the controller 2 0 instructs the image input apparatus 40 to 
start reading images either in the color mode or in the 
monochromatic mode according to the readout mode setting. 
[ 0050] The image input apparatus 40 reads the document image 
according to the operation start instruction from the 
controller 20. The generated image data is transmitted to 
the character recognition unit 11 of the image processing 
apparatus 10 via the interface 23 of the controller 20. 
[0051] The character recognition unit 11 separates 

character areas from the image data and extract character 
images existing in the character areas . The image data left 
after removing the character images are inputted into the 
area separation unit 12. The character recognition unit 11 
extracts character information including character code data 
and positional information, and color information from the 
character images . 
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[0052 J The positional information includes X-Y coordinates , 
widths, lengths, etc. The character information is inputted 
into the synthesizing unit 16 . When binarization is specified 
as the post-processing of the output area by the user, the 
character area is inputted into the binarization unit 15. 
[0053] The area separation unit 12 separates graphics areas 
and photographic areas from the image data . The photographic 
area data will be added with positional information and will 
be inputted into the bitmap processing unit 13. 
[0054] On the other hand, the data in the graphics area 
will be added with positional information and will be inputted 
into the vector conversion unit 14. If the post-processing 
is specified, the image data after area separation will be 
inputted into the bitmap processing unit 13 or the vector 
conversion unit 14 or the binarization unit 15 according to 
the details of specified matter. 

[0055] The bitmap processing unit 13 applies the bitmap 
processing to the data in the photographic area . In the bitmap 
processing, the data of the photographic area is applied with 
various image processes such as the edge correction, the 
smoothing and the MTF correction. The bitmap information 
including the bitmap data and the positional information will 
be inputted into the synthesizing unit 16. The bitmap 
processing unit 13 will execute the similar process to the 
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image data, to which the bitmap processing is specified as 
the post-processing. 

[0056] The vector conversion unit 14 applies 

vector-conversion to the data in the graphics area to generate 
vector data . The vector data is inputted into the synthes izing 
unit 16 together with the attribute data. The vector 
conversion means converting graphics consisting of dots into 
vector data such as straight lines, arcs, Bezier curves, etc. 
[0057] The attribute data are data obtained by extracting 
line widths, line types, line colors, end point styles, and 
colors of enclosed areas surrounded by vector data. The vector 
conversion unit 14 executes the similar process to image data, 
to which vector conversion is designated as the 
post-processing. 

[0058] The binarization unit 15 binarizes the image data 
from the character recognition unit 11 and/or the area 
separation unit 12, when the binarization process is specified 
as the post-processing. The binarization data is inputted 
into the synthesizing unit 1 6 with the positional information . 
[0059] The synthesizing unit 16 synthesizes the input data 
from the character recognition unit 11 , the bitmap processing 
unit 13, the vector conversion unit 14, and the binarization 
unit 15 . The synthesized data is converted into intermediate 
format data and inputted into the format conversion unit 18. 
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[0060] The intermediate format data are intermediate data 
between the synthesized data and the output format data, and 
are generated in order to facilitate the processing at the 
format conversion unit 18. 

[0061] If the consistency process is specified, the 

synthesizing unit 16 provides consistent relations between 
drawings and character strings, which are the drawing 
identification descriptions using an allocation table. 
Similarly, the synthesizing unit 16 also provides consistent 
relations to character strings, which are page number 
identification descriptions . 

[0062] The allocation table has, as shown in Fig. 2A and 
Fig. 2B, the page number section, the drawing identification 
section, the drawing section, the caption section, the 
insertion section, and the text section. 

[0063] In the page number section, the detected character 
string as the existing page number identification description, 
memory address of the detected character string, the 
positional information of the detected character string, and 
the replacing character string for the detected character 
string are set up. 

[0064] In the drawing identification section, the detected 
character string as the existing drawing identification 
description, and the replacing character string for the 
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detected character string are set up. in the drawing section, 
memory addres s of the drawing , which corresponds to the drawing 
identification description, and the positional information 
of the drawing are set up. 

[0065] In the caption section, memory address and the 
positional information of the caption are set up . The caption 
is the character string to be added in the vicinity of the 
drawing, and contains the drawing identification description . 
[0066] in the insertion section, memory address and 

positional information of an insertion character string are 
set up. The insertion character string is the drawing 
identification description that exists in the character code 
data other than those of the character string concerning the 
caption. 

[0067] In the text section, memory address and the 

positional information of the character code data other than 
those of the character string concerning the page number 
identification description and the caption are set up. 
[0068] The memory 17 is used for storing the allocation 
table and the input data for and the synthesizing unit 16. 
[0069] The format conversion unit 18 converts the 

intermediate format data into the data of the specified output 
format. The output format data is inputted into the first 
output apparatus 50 and/or the second output apparatus 60 
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via the interface 24. 

[0070] As an example, the first output apparatus 50 prints 
the data on paper, and the second output apparatus 60 stores 
the data and displays it on the monitor. 

[0071] Next, the consistency process will be described 
referring to the flow chart shown in Fig. 3. 
[0072] First, character areas are separated from the image 
data (step Si), and the character information is extracted 
from character images in the character areas (step S2 ) . The 
image data, from which the character images are removed, are 
interpolated using the peripheral pixels of the character 
images (step S3 ) . 

[0073] Then, photographic areas and graphics areas are 
separated from the image data (step S4). The photographic 
area data are treated by the bitmap process , and the graphics 
area data are treated by the vector conversion process (step 
S5). 

[0074] After that, the first correlating process 

concerning the allocation table is executed based on the 
character information, the bitmap information, and the vector 
data (step S6) . 

[0075] The first correlating process is a process of 
detecting character strings, which are the existing drawing 
identification descriptions, based on the captions added in 



- 17 - 



the vicinity of the drawings included in a document , extracting 
the positional information of the detected character strings 
from the character information containing the captions, and 
determining the corresponding relations between the detected 
character strings, the positional information of the detected 
character strings and the drawings. 

[0076] The character strings, which are the existing page 
number identification descriptions, are also detected 
similarly. 

[0077] Next, a judgment is made whether there is a next 
page image data (step S7). If it is judged that there is a 
next page, the process returns to the step SI. If the next 
page does not exist, or if the process of the last page is 
completed, the second correlating process concerning the 
allocation table is executed (step S8). 

[0078] The second correlating process is a process of 
generating character strings, which are the drawing 
identification descriptions for uniquely identifying the 
drawings, and replacing the detected character strings, which 
are the existing drawing identification descriptions, with 
the generated character strings, based on the corresponding 
relations obtained in the first correlating process. 
[0079] in addition, character strings for uniquely 

identifying the page numbers are also generated similarly 
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and the character strings, which are the existing page number 
identification descriptions , are replaced with the character 
strings. 

[0080] Then, image data is synthesized based on the 

allocation table obtained {step S9), and the image data is 
converted into the intermediate format data (step S10) . The 
intermediate format data is converted into the specified 
output format data and outputted (step Sll, 12). 
[0081] Lastly, a judgment is made whether there is a next 
page image data (step S13). If it is judged that there is 
a next page, the process returns to the step S9. If the next 
page does not exist, or if the process of the last page is 
completed, the process will be terminated. 
[0082] Next, the first correlating process will be 

described referring to the flow chart shown in Fig. 4. 
[0083] First, candidates of the character strings, which 
are the page number identification descriptions, are 
extracted from the character code data (step S61 ) . Then, the 
character strings, which are the page number identification 
descriptions, are detected based on the positional 
information of the candidates (step S62). 

[ 0084] The data of the detected character strings are stored 
in the memory 17 ( step S63 ) . The detected character strings , 
the memory addresses of the detected character strings, and 
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the positional information of the detected character strings 
are set up in the page number section of the allocation table 
(step S64) . 

[0085] After that, candidates of the character strings, 
which are the drawing identification descriptions, are 
extracted from the character code data (step S65). 
[0086] Next, captions are detected based on the coordinate 
position of the character area where the candidates exist, 
the number of rows, width and height of the character area, 
and whether there are any photographic areas or graphics areas 
exist in the neighborhoods, and the candidates that belong 
to the caption are detected as the character strings, which 
are the drawing identification descriptions (step S66). 
[0087] The data of the captions are stored in the memory 
17 (step S67) . The detected character strings are set up in 
the drawing identification sections of the allocation table 
(S68) , and the memory addresses and the positional information 
of the caption are set up in the caption section (step S69). 
[0088] Next, drawings that correspond to the captions are 
detected based on the bitmap data of the photographic areas 
or the vector data of the graphics areas located in the 
vicinities of the coordinate positions of the captions (step 
S70 ) . The detected drawings ' data are stored into the memory 
17 (step S71) . 
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[0089] The memory address and the positional information 
of the detected drawings are set in the drawing section of 
the allocation table in correlation with the drawing 
identification descriptions (step S72). 

[0090] The data of the remaining drawings consisting of 
bitmap data and/or vector data that is not correlated to the 
caption are stored in the memory 17 (step S73) . The memory 
address and positional information of the remaining drawings 
are set up in the drawing section of the allocation table 
without being correlated to the drawing identification 
descriptions (step S74). 

[0091] Next, the character code data of the character area, 
other than the character strings related to the page number 
identification descriptions and captions, is stored into the 
memory 17 (step S75). The memory address and positional 
information of the character code data is set up in the text 
section of the allocation table (step S76). 
[0092] Then, the insertion character strings, which are 
the drawing identification descriptions inserted in the 
character area, i.e. , the drawing identification descriptions 
existing in the character code data are detected (step S77) . 
[ 0093 ] The data of the insertion character strings is stored 
in the memory 17 (step S78). The memory address and the 
positional information of the insertion character string are 
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set up in the insertion section of the allocation table in 
correlation with the drawing identification description (step 
S79) . 

[0094] Next, the first correlating process will be 

concretely described using the first page image shown in Fig. 
5A and the second page image shown in Fig. 5B. 
[0095] The data of the character string 71 , which is the 
page number identification description of the first page, 
and the data of the character string 72, which is the page 
number identification description of the second page, are 
stored in the first memory area of the memory 17, which is 
the memory area for storing the page number identification 
descriptions . 

[0096] "PAGE 1" and "PAGE 2" that correspond to the character 
strings 71 and 72 are set in the detected character strings 
of the page number section. The starting address of the 
character string 71 is indicated as Padrl, and the starting 
address of the character string 72 is indicated as Padr2 . 
[0097] The character strings 81, 82 and 83, which are the 
captions of the first page, and the character strings 84 and 
85, which are the captions of the second page, are stored 
in the second memory area of the memory 17, which is a memory 
area for preserving the captions. 

[0098] "Fig. 1," "Fig. 2," ""Fig. 3," "Fig. 1," "Fig. 2," 
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which correspond to the character strings 81 through 85, are 
set in the detected character strings of the drawing 
identification section. The starting addresses of the 
character strings 81 , 82 and 83 are indicated by Nadrl, Nadr2 
and Nadr3 , and the starting addresses of the character strings 
84 and 85 are indicated by Nadr4 and Nadr5 . 
[0099] The data of the drawings 91, 92 and 93, which 
correspond to the captions of the first page, and the data 
of the drawings 94 and 95, which correspond to the captions 
of the second page, are stored in the third memory area of 
the memory 17 , which is the memory area for storing the drawing 
data. 

[0100] Furthermore, the drawings 91, 92, 93, 94 and 95, 
are correlated to "Fig. 1," "Fig. 2," "Fig. 3," "Fig. 1," 
and "Fig. 2." The starting addresses of the drawings 91, 92 
and 93 are indicated by Fadrl , Fadr2 and Fadr3 , and the starting 
addresses of the drawings 94 and 95 are indicated by Fadr4 
and Fadr5. 

[0101] The data of the character area 101 and the insertion 
character strings 101A, 101B and 101C of the first page, and 
the data of the character areas 102, 103 and the insertion 
character strings 102A, 103A and 103B of the second page are 
stored in the fourth memory area of the memory 17 . Furthermore, 
the insertion character strings 10 1A, 101B, 101C, 102A, 103A 
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and 103B are correlated to "Fig. 2," "Fig. 1," "drawing below, " 
"Fig. 2," and "Fig. 1." 

[0102] The starting address of the character area 101 of 
the first page is indicated by Cadrl , and the starting addresses 
of the insertion character string 102A, 103A and 103B are 
indicated by Cadr2 , Cadr3 and Cadr4 . The starting address 
of the character area 102 on the top of the second page is 
indicated by Cadr5, and the starting address of the insertion 
character string 102A is indicated by Cadr6. 
[0103] The starting address of the character area 103 on 
the bottom of the second page is indicated by Cadr7, and the 
starting addresses of the insertion character strings 103A 
and 103B are indicated by Cadr8 and Cadr9. 
[0104] Consequently, the data such as shown in Fig. 6A and 
Fig. 6B is set on the allocation table. 

[0105] Next, the second correlating process will be 

described referring to the flow chart shown in Fig. 7. 
[0106] First, a group of unique page number identification 
descriptions numbered in an ascending order is allocated to 
the replacing character strings of the page number section 
( step S81 ) . Then, the data indicated by the memory addresses 
in the page number section are changed to the allocated group 
of page number identification descriptions (step S82). 
[0107] Next, a group of unique drawing identification 
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descriptions numbered in an ascending order is allocated to 
the replacing character strings of the drawing identification 
section (step S83) . Then, the data indicated by the memory 
addresses in the caption section are changed to the allocated 
group of drawing identification descriptions (step S84). 
[0108] Consequently, the allocation table shown in Fig. 
8A and Fig. 8B is obtained. Reading the data from the memory 
17 and synthesizing them based on the allocation table, an 
output image having groups of consistent captions and page 
number identification descriptions is obtained as shown in 
Fig. 9A and Fig. 9B. 

[0109] More specifically, the insertion character string 
101C, "drawing below," on the first page is replaced by the 
character string, "Fig. 3." The insertion character string 
72, "PAGE 1," as the page number identification description 
on the second page is replaced by the character string, "PAGE 
2," and the character strings 84 and 85, "Fig. 1" and "Fig. 
2," as the captions on the second page are replaced by the 
character strings, "Fig. 4" and "Fig. 5." 

[0110] The insertion character strings 102A, 103Aandl03B, 
"Fig. 1," "Fig. 2" and "Fig. 1," of the second page are replaced 
by the character strings, "Fig. 4," "Fig. 5" and "Fig. 4" 
respectively . 

[0111] As can be seen from the above, the first embodiment 
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of the invention can provide a consistent relation between 
the drawings and the character strings contained in the 
captions , which are the drawing identification descriptions . 
[0112] It is possible to obtain a copied document that 
contains a group of captions having consistent drawing 
identification descriptions from documents containing the 
same drawing identification descriptions . Accordingly, the 
document filing work is simplified and the value of the document 
increases. 

[0113] Moreover, since the process applied on the page 
number identification descriptions is similar to the one that 
is applied on the drawing identification descriptions in the 
first embodiment, it is possible to obtain a copied document 
with a group of consistent page number identification 
descriptions from base documents containing the same page 
number identification descriptions. 

[0114] Next, the second embodiment will be described. 
[0115] The consistency process in the second embodiment 
relates to editing processes that accompany layout changes 
that unite several document image data in case of copying. 
The layout change process mentioned here is, for example, 
the N-in-1 process. Therefore, the second embodiment is 
different from the first embodiment in the function of the 
synthesizing unit 16. 



- 26 - 



[0116] Referring to a flowchart of Fig. 10 , the consistency 
process in case of the 2-in-l mode will be described below 
using input images shown in Fig. 5A and Fig. 5B as an example. 
[0117] First, by executing the steps S101 through S107 
similar to the first embodiment, the allocation table shown 
in Fig. 6A and Fig. 6B is obtained before the image data is 
integrated, i.e., before the layout is changed. 
[0118] After that, an allocation table updating process 
is executed (step S108). The allocation table updating 
process is a process of correcting the data set at the 
allocation table in accordance with the correction of data 
such as the changes of positional information due to the layout 
change process. 

[0119] Next, the second correlating process is executed 
to obtain the final allocation table to be used for data 
synthes iz ing ( step S 1 0 9 ) . By executing the steps S 1 1 0 through 
S114 similar to the first embodiment, an output image having 
groups of consistent captions and page number identification 
descriptions is obtained. 

[0120] As can be seen from the above, the consistency process 
according to the second embodiment is essentially identical 
to the consistency process of the first embodiment except 
the allocation table updating process. 

[0121] Next, the updating process of the allocation table 
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will be described in detail referring to the flow chart shown 
in Fig. 11. 

[0122] First, the data of the detected character string 
72, which is the page number identification description of 
Fig. 5B, is deleted from the first memory area, and the memory- 
address Padr2 and the positional information of the detected 
character string 72 are removed from the allocation table 
(step S181) . Consequently, the data of the even number page 
moves to the odd page immediately before it and the data of 
the two pages are integrated as the data for one page. 
[0123] After that, in order to make the position of the 
detected character string 71 correspond with the layout 
setting, the data of the detected character string 71 stored 
in the first memory area is changed and the positional 
information in the page number section is corrected (step 
S182) . 

[0124] Next, the data of the character areas 101 through 
103 are integrated (step S183), and the reduction factor for 
the new character area 104 where the integrated data is to 
be placed is calculated (step Si 84 ) . The data of the character 
areas 101 through 103 stored in the fourth memory area are 
changed based on the reduction factor and the layout setting, 
and the memory addresses Cadrl , Cadr5, Cadr7 and the positional 
information in the text section are changed (step S185). 
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[0125] The data for the insertion character strings 101A 
through 101C, 102A, 103A and 103B are simultaneously changed, 
and the memory addresses Cadr2 through Cadr4, Cadr6, Cadr8 
and Cadr9 and positional information in the insertion section 
are corrected. The addresses after correction are indicated 
by Cadrl ' through Cadr9 ' . 

[0126] Then, the reduction factor of the area where drawings 
91 through 95 are located, i.e. , the drawing area, is calculated 
(step S186). Then, the data of the drawings 91 through 95 
stored in the third memory area are changed based on the 
reduction factor and the layout setting, and the memory 
addresses and the positional information in the drawing 
section is changed (step S187). The addresses after 
correction are indicated by Fadrl ' through Fadr5 ' . 
[0127] With the change of the data of drawings 91 through 
95, the data of the captions stored in the second memory area 
are changed, and the memory addresses and the positional 
information of the caption section are corrected ( step S188 ) . 
The addresses after correction are indicated by Nadrl ' through 
Nadr5 ' . 

[0128] Consequently, the data of the allocation table shown 
in Fig. 6A and Fig. 6B are updated, and a new allocation table 
shown in Fig. 12A and Fig. 12B is obtained. After that, the 
second correlating process is executed and groups of page 
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number identification descriptions and drawing 
identification descriptions are allocated to the updated 
allocation table as show in Fig. 13A and Fig. 13B. By reading 
the data out of the memory 17 and synthesizing them based 
on the allocation table, an output image having groups of 
consistent captions and page number identification 
descriptions is obtained as shown in Fig. 14. 
[0129] In the second embodiment, as can be seen from the 
above, the groups of page number identification description 
and drawing identification descriptions are corrected to 
avoid overlapping. 

[0130] It is obvious that this invention is not limited 
to the particular embodiments shown and described above but 
may be variously changed and modified without departing from 
the technical concept of this invention. 

[0131] For example, the allocation of the groups of page 
number identification descriptions and drawing 
identification descriptions can not only be applied in the 
numbering method of the ascending order, but also is applicable 
in the numbering method of the descending order or in a 
arbitrary order as long as it is unique. 
[ 0132 ] Moreover , the allocation of the groups of page number 
identification descriptions and drawing identification 
descriptions is not limited to the numbers alone . For example , 
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it is possible to apply to the group of page number 
identification descriptions a combination notation 
consisting of a number and an alphabetic character such as 
"1A" and " IB" or a combination of a character string meaning 
"page" and a number such as "P. 1" and "P. 2" or "PAGE 1" 
and " PAGE 2." 

[0133] Similarly, it is possible to apply to the group of 
drawing identification descriptions a combination notation 
consisting of a number and an alphabetic character such as 
"1A" and "IB" or a combination of a character string meaning 
"drawing" and a number such as "Fig. 1" and "Fig. 2" or "Figure 
1" and "Figure 2." 

[0134] The invention is applicable not only to a system 
including a plurality of apparatuses, but also to standalone 
equipment such as digital copying machines . 
[0135] It is also possible to make a computer function as 
an image processing apparatus by providing a program product 
containing the code data of the programmed image processing 
method. Such a program product includes a program itself and 
a storage medium that contains the program. 
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